Pandas Profiling Report

Dataset statistics

Number of variables	13
Number of observations	79853
Missing cells	3265
Missing cells (%)	0.3%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	7.9 MiB
Average record size in memory	104.0 B

Variable types

Numeric	10
Categorical	3

Warnings

`Income` is highly correlated with `premium`	High correlation
`premium` is highly correlated with `Income`	High correlation
`Income` is highly correlated with `premium`	High correlation
`premium` is highly correlated with `Income`	High correlation
`application_underwriting_score` has 2974 (3.7%) missing values	Missing
`Income` is highly skewed (γ1 = 109.7611714)	Skewed
`id` is uniformly distributed	Uniform
`id` has unique values	Unique
`perc_premium_paid_by_cash_credit` has 5723 (7.2%) zeros	Zeros
`Count_3-6_months_late` has 66801 (83.7%) zeros	Zeros
`Count_6-12_months_late` has 75831 (95.0%) zeros	Zeros
`Count_more_than_12_months_late` has 76038 (95.2%) zeros	Zeros

Reproduction

Analysis started	2021-10-18 16:31:55.389468
Analysis finished	2021-10-18 16:32:48.342666
Duration	52.95 seconds
Software version	pandas-profiling v3.0.0
Download configuration	config.json

id
Real number (ℝ_≥0)

UNIFORM
UNIQUE

Distinct	79853
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	57167.16637

Minimum	2
Maximum	114076
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	2
5-th percentile	5802.6
Q1	28640
median	57262
Q3	85632
95-th percentile	108370.4
Maximum	114076
Range	114074
Interquartile range (IQR)	56992

Descriptive statistics

Standard deviation	32928.97016
Coefficient of variation (CV)	0.5760119357
Kurtosis	-1.200640812
Mean	57167.16637
Median Absolute Deviation (MAD)	28494
Skewness	-0.004028155358
Sum	4564969736
Variance	1084317076
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2047	1	< 0.1%
39558	1	< 0.1%
82557	1	< 0.1%
88702	1	< 0.1%
86655	1	< 0.1%
43648	1	< 0.1%
47746	1	< 0.1%
45699	1	< 0.1%
33413	1	< 0.1%
60040	1	< 0.1%
Other values (79843)	79843	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	1	< 0.1%
3	1	< 0.1%
5	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%
13	1	< 0.1%
14	1	< 0.1%
15	1	< 0.1%
19	1	< 0.1%

Value	Count	Frequency (%)
114076	1	< 0.1%
114075	1	< 0.1%
114074	1	< 0.1%
114073	1	< 0.1%
114071	1	< 0.1%
114070	1	< 0.1%
114069	1	< 0.1%
114066	1	< 0.1%
114065	1	< 0.1%
114063	1	< 0.1%

perc_premium_paid_by_cash_credit
Real number (ℝ_≥0)

ZEROS

Distinct	1001
Distinct (%)	1.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.3142877412

Minimum	0
Maximum	1
Zeros	5723
Zeros (%)	7.2%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0.034
median	0.167
Q3	0.538
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	0.504

Descriptive statistics

Standard deviation	0.3349145654
Coefficient of variation (CV)	1.065630381
Kurtosis	-0.6144351478
Mean	0.3142877412
Median Absolute Deviation (MAD)	0.158
Skewness	0.8929224698
Sum	25096.819
Variance	0.1121677661
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	5723	7.2%
1	5004	6.3%
0.001	698	0.9%
0.002	612	0.8%
0.003	551	0.7%
0.004	541	0.7%
0.006	541	0.7%
0.005	530	0.7%
0.01	496	0.6%
0.008	488	0.6%
Other values (991)	64669	81.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	5723	7.2%
0.001	698	0.9%
0.002	612	0.8%
0.003	551	0.7%
0.004	541	0.7%
0.005	530	0.7%
0.006	541	0.7%
0.007	463	0.6%
0.008	488	0.6%
0.009	473	0.6%

Value	Count	Frequency (%)
1	5004	6.3%
0.999	43	0.1%
0.998	38	< 0.1%
0.997	52	0.1%
0.996	51	0.1%
0.995	46	0.1%
0.994	49	0.1%
0.993	43	0.1%
0.992	50	0.1%
0.991	42	0.1%

age_in_days
Real number (ℝ_≥0)

Distinct	833
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	18846.69691

Minimum	7670
Maximum	37602
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	7670
5-th percentile	10596
Q1	14974
median	18625
Q3	22636
95-th percentile	27754
Maximum	37602
Range	29932
Interquartile range (IQR)	7662

Descriptive statistics

Standard deviation	5208.719136
Coefficient of variation (CV)	0.2763730516
Kurtosis	-0.4597678551
Mean	18846.69691
Median Absolute Deviation (MAD)	3654
Skewness	0.2225719582
Sum	1504965288
Variance	27130755.04
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17899	226	0.3%
16802	223	0.3%
17895	219	0.3%
17163	217	0.3%
16801	216	0.3%
19350	213	0.3%
18261	212	0.3%
17894	211	0.3%
19358	210	0.3%
17528	209	0.3%
Other values (823)	77697	97.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
7670	3	< 0.1%
7671	3	< 0.1%
7672	7	< 0.1%
7673	3	< 0.1%
7674	6	< 0.1%
7675	5	< 0.1%
7676	7	< 0.1%
7677	7	< 0.1%
7678	5	< 0.1%
7679	7	< 0.1%

Value	Count	Frequency (%)
37602	1	< 0.1%
37240	1	< 0.1%
37239	1	< 0.1%
36874	1	< 0.1%
36870	1	< 0.1%
36150	1	< 0.1%
36145	2	< 0.1%
35784	1	< 0.1%
35419	1	< 0.1%
35417	1	< 0.1%

Income
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	24165
Distinct (%)	30.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	208847.1712

Minimum	24030
Maximum	90262600
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	24030
5-th percentile	54030
Q1	108010
median	166560
Q3	252090
95-th percentile	450050
Maximum	90262600
Range	90238570
Interquartile range (IQR)	144080

Descriptive statistics

Standard deviation	496582.5973
Coefficient of variation (CV)	2.377731977
Kurtosis	16639.12845
Mean	208847.1712
Median Absolute Deviation (MAD)	68250
Skewness	109.7611714
Sum	1.667707316 × 10¹⁰
Variance	2.465942759 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
150130	171	0.2%
150060	162	0.2%
150090	158	0.2%
150120	157	0.2%
150050	154	0.2%
150100	152	0.2%
150070	149	0.2%
150110	142	0.2%
150030	136	0.2%
150080	135	0.2%
Other values (24155)	78337	98.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
24030	13	< 0.1%
24040	10	< 0.1%
24050	11	< 0.1%
24060	2	< 0.1%
24070	3	< 0.1%
24080	10	< 0.1%
24090	8	< 0.1%
24100	8	< 0.1%
24110	13	< 0.1%
24120	13	< 0.1%

Value	Count	Frequency (%)
90262600	1	< 0.1%
53821900	1	< 0.1%
46803140	1	< 0.1%
32175090	1	< 0.1%
25051240	1	< 0.1%
21075130	1	< 0.1%
20986030	1	< 0.1%
17471210	1	< 0.1%
16874010	1	< 0.1%
12847560	1	< 0.1%

Count_3-6_months_late
Real number (ℝ_≥0)

ZEROS

Distinct	14
Distinct (%)	< 0.1%
Missing	97
Missing (%)	0.1%
Infinite	0
Infinite (%)	0.0%
Mean	0.2486709464

Minimum	0
Maximum	13
Zeros	66801
Zeros (%)	83.7%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	2
Maximum	13
Range	13
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.6914680986
Coefficient of variation (CV)	2.780654953
Kurtosis	24.90942403
Mean	0.2486709464
Median Absolute Deviation (MAD)	0
Skewness	4.150115635
Sum	19833
Variance	0.4781281314
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=14)

Value	Count	Frequency (%)
0	66801	83.7%
1	8826	11.1%
2	2519	3.2%
3	954	1.2%
4	374	0.5%
5	168	0.2%
6	68	0.1%
7	23	< 0.1%
8	15	< 0.1%
9	4	< 0.1%
Other values (4)	4	< 0.1%
(Missing)	97	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	66801	83.7%
1	8826	11.1%
2	2519	3.2%
3	954	1.2%
4	374	0.5%
5	168	0.2%
6	68	0.1%
7	23	< 0.1%
8	15	< 0.1%
9	4	< 0.1%

Value	Count	Frequency (%)
13	1	< 0.1%
12	1	< 0.1%
11	1	< 0.1%
10	1	< 0.1%
9	4	< 0.1%
8	15	< 0.1%
7	23	< 0.1%
6	68	0.1%
5	168	0.2%
4	374	0.5%

Count_6-12_months_late
Real number (ℝ_≥0)

ZEROS

Distinct	17
Distinct (%)	< 0.1%
Missing	97
Missing (%)	0.1%
Infinite	0
Infinite (%)	0.0%
Mean	0.07818847485

Minimum	0
Maximum	17
Zeros	75831
Zeros (%)	95.0%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	17
Range	17
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.4365074263
Coefficient of variation (CV)	5.582759188
Kurtosis	185.0243945
Mean	0.07818847485
Median Absolute Deviation (MAD)	0
Skewness	10.35329931
Sum	6236
Variance	0.1905387333
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
0	75831	95.0%
1	2680	3.4%
2	693	0.9%
3	317	0.4%
4	130	0.2%
5	46	0.1%
6	26	< 0.1%
7	11	< 0.1%
8	5	< 0.1%
10	4	< 0.1%
Other values (7)	13	< 0.1%
(Missing)	97	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	75831	95.0%
1	2680	3.4%
2	693	0.9%
3	317	0.4%
4	130	0.2%
5	46	0.1%
6	26	< 0.1%
7	11	< 0.1%
8	5	< 0.1%
9	4	< 0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
15	1	< 0.1%
14	2	< 0.1%
13	2	< 0.1%
12	1	< 0.1%
11	2	< 0.1%
10	4	< 0.1%
9	4	< 0.1%
8	5	< 0.1%
7	11	< 0.1%

Count_more_than_12_months_late
Real number (ℝ_≥0)

ZEROS

Distinct	10
Distinct (%)	< 0.1%
Missing	97
Missing (%)	0.1%
Infinite	0
Infinite (%)	0.0%
Mean	0.06000802447

Minimum	0
Maximum	11
Zeros	76038
Zeros (%)	95.2%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	11
Range	11
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.3120227225
Coefficient of variation (CV)	5.199683296
Kurtosis	98.44852981
Mean	0.06000802447
Median Absolute Deviation (MAD)	0
Skewness	7.850187565
Sum	4786
Variance	0.09735817936
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	76038	95.2%
1	2996	3.8%
2	498	0.6%
3	151	0.2%
4	48	0.1%
5	13	< 0.1%
6	6	< 0.1%
7	3	< 0.1%
8	2	< 0.1%
11	1	< 0.1%
(Missing)	97	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	76038	95.2%
1	2996	3.8%
2	498	0.6%
3	151	0.2%
4	48	0.1%
5	13	< 0.1%
6	6	< 0.1%
7	3	< 0.1%
8	2	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
11	1	< 0.1%
8	2	< 0.1%
7	3	< 0.1%
6	6	< 0.1%
5	13	< 0.1%
4	48	0.1%
3	151	0.2%
2	498	0.6%
1	2996	3.8%
0	76038	95.2%

application_underwriting_score
Real number (ℝ_≥0)

MISSING

Distinct	672
Distinct (%)	0.9%
Missing	2974
Missing (%)	3.7%
Infinite	0
Infinite (%)	0.0%
Mean	99.0672912

Minimum	91.9
Maximum	99.89
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	91.9
5-th percentile	97.81
Q1	98.81
median	99.21
Q3	99.54
95-th percentile	99.87
Maximum	99.89
Range	7.99
Interquartile range (IQR)	0.73

Descriptive statistics

Standard deviation	0.7397990154
Coefficient of variation (CV)	0.007467641504
Kurtosis	13.98790359
Mean	99.0672912
Median Absolute Deviation (MAD)	0.36
Skewness	-2.756097905
Sum	7616194.28
Variance	0.5473025832
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
99.89	1972	2.5%
99.88	1343	1.7%
99.87	856	1.1%
99.86	693	0.9%
99.3	642	0.8%
99.38	633	0.8%
99.31	623	0.8%
99.28	617	0.8%
99.37	616	0.8%
99.23	614	0.8%
Other values (662)	68270	85.5%
(Missing)	2974	3.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
91.9	1	< 0.1%
91.96	3	< 0.1%
91.98	1	< 0.1%
92.03	2	< 0.1%
92.07	1	< 0.1%
92.13	2	< 0.1%
92.15	1	< 0.1%
92.16	1	< 0.1%
92.17	1	< 0.1%
92.2	1	< 0.1%

Value	Count	Frequency (%)
99.89	1972	2.5%
99.88	1343	1.7%
99.87	856	1.1%
99.86	693	0.9%
99.85	550	0.7%
99.84	463	0.6%
99.83	413	0.5%
99.82	358	0.4%
99.81	372	0.5%
99.8	379	0.5%

no_of_premiums_paid
Real number (ℝ_≥0)

Distinct	57
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10.86388739

Minimum	2
Maximum	60
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	2
5-th percentile	4
Q1	7
median	10
Q3	14
95-th percentile	20
Maximum	60
Range	58
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	5.170687238
Coefficient of variation (CV)	0.475951844
Kurtosis	3.325117066
Mean	10.86388739
Median Absolute Deviation (MAD)	3
Skewness	1.226636685
Sum	867514
Variance	26.73600651
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
8	7184	9.0%
9	7158	9.0%
10	6873	8.6%
7	6623	8.3%
11	6395	8.0%
6	5635	7.1%
12	5407	6.8%
13	4752	6.0%
5	4215	5.3%
14	3988	5.0%
Other values (47)	21623	27.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	726	0.9%
3	1746	2.2%
4	2907	3.6%
5	4215	5.3%
6	5635	7.1%
7	6623	8.3%
8	7184	9.0%
9	7158	9.0%
10	6873	8.6%
11	6395	8.0%

Value	Count	Frequency (%)
60	1	< 0.1%
59	1	< 0.1%
58	2	< 0.1%
56	3	< 0.1%
55	1	< 0.1%
54	2	< 0.1%
53	2	< 0.1%
52	2	< 0.1%
51	3	< 0.1%
50	3	< 0.1%

sourcing_channel
Categorical

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	624.0 KiB

A	43134
B	16512
C	12039
D	7559
E	609

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	79853
Distinct characters	5
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	C
2nd row	A
3rd row	C
4th row	A
5th row	B

Common Values

Value	Count	Frequency (%)
A	43134	54.0%
B	16512	20.7%
C	12039	15.1%
D	7559	9.5%
E	609	0.8%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
a	43134	54.0%
b	16512	20.7%
c	12039	15.1%
d	7559	9.5%
e	609	0.8%

Most occurring characters

Value	Count	Frequency (%)
A	43134	54.0%
B	16512	20.7%
C	12039	15.1%
D	7559	9.5%
E	609	0.8%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	79853	100.0%

Most frequent character per category

Uppercase Letter

Value	Count	Frequency (%)
A	43134	54.0%
B	16512	20.7%
C	12039	15.1%
D	7559	9.5%
E	609	0.8%

Most occurring scripts

Value	Count	Frequency (%)
Latin	79853	100.0%

Most frequent character per script

Latin

Value	Count	Frequency (%)
A	43134	54.0%
B	16512	20.7%
C	12039	15.1%
D	7559	9.5%
E	609	0.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	79853	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
A	43134	54.0%
B	16512	20.7%
C	12039	15.1%
D	7559	9.5%
E	609	0.8%

residence_area_type
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	624.0 KiB

Urban	48183
Rural	31670

Length

Max length	5
Median length	5
Mean length	5
Min length	5

Characters and Unicode

Total characters	399265
Distinct characters	8
Distinct categories	2 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Urban
2nd row	Urban
3rd row	Rural
4th row	Urban
5th row	Urban

Common Values

Value	Count	Frequency (%)
Urban	48183	60.3%
Rural	31670	39.7%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
urban	48183	60.3%
rural	31670	39.7%

Most occurring characters

Value	Count	Frequency (%)
r	79853	20.0%
a	79853	20.0%
U	48183	12.1%
b	48183	12.1%
n	48183	12.1%
R	31670	7.9%
u	31670	7.9%
l	31670	7.9%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	319412	80.0%
Uppercase Letter	79853	20.0%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
r	79853	25.0%
a	79853	25.0%
b	48183	15.1%
n	48183	15.1%
u	31670	9.9%
l	31670	9.9%

Uppercase Letter

Value	Count	Frequency (%)
U	48183	60.3%
R	31670	39.7%

Most occurring scripts

Value	Count	Frequency (%)
Latin	399265	100.0%

Most frequent character per script

Latin

Value	Count	Frequency (%)
r	79853	20.0%
a	79853	20.0%
U	48183	12.1%
b	48183	12.1%
n	48183	12.1%
R	31670	7.9%
u	31670	7.9%
l	31670	7.9%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	399265	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
r	79853	20.0%
a	79853	20.0%
U	48183	12.1%
b	48183	12.1%
n	48183	12.1%
R	31670	7.9%
u	31670	7.9%
l	31670	7.9%

premium
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	30
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10924.50753

Minimum	1200
Maximum	60000
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	624.0 KiB

Quantile statistics

Minimum	1200
5-th percentile	1200
Q1	5400
median	7500
Q3	13800
95-th percentile	28500
Maximum	60000
Range	58800
Interquartile range (IQR)	8400

Descriptive statistics

Standard deviation	9401.676542
Coefficient of variation (CV)	0.8606041521
Kurtosis	6.67178945
Mean	10924.50753
Median Absolute Deviation (MAD)	4200
Skewness	2.19817831
Sum	872354700
Variance	88391521.8
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=30)

Value	Count	Frequency (%)
5400	10932	13.7%
7500	10194	12.8%
3300	9857	12.3%
9600	8419	10.5%
1200	6900	8.6%
11700	6832	8.6%
13800	6548	8.2%
5700	3071	3.8%
18000	3062	3.8%
15900	2831	3.5%
Other values (20)	11207	14.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1200	6900	8.6%
3300	9857	12.3%
5400	10932	13.7%
5700	3071	3.8%
7500	10194	12.8%
9600	8419	10.5%
11700	6832	8.6%
13800	6548	8.2%
15900	2831	3.5%
18000	3062	3.8%

Value	Count	Frequency (%)
60000	419	0.5%
57900	187	0.2%
55800	52	0.1%
53700	71	0.1%
51600	81	0.1%
49500	100	0.1%
47400	134	0.2%
45300	141	0.2%
43200	158	0.2%
41100	207	0.3%

target
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	624.0 KiB

1	74855
0	4998

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	79853
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	1
3rd row	0
4th row	1
5th row	1

Common Values

Value	Count	Frequency (%)
1	74855	93.7%
0	4998	6.3%

Length

Histogram of lengths of the category

Pie chart

Value	Count	Frequency (%)
1	74855	93.7%
0	4998	6.3%

Most occurring characters

Value	Count	Frequency (%)
1	74855	93.7%
0	4998	6.3%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	79853	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	74855	93.7%
0	4998	6.3%

Most occurring scripts

Value	Count	Frequency (%)
Common	79853	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	74855	93.7%
0	4998	6.3%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	79853	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	74855	93.7%
0	4998	6.3%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	id	perc_premium_paid_by_cash_credit	age_in_days	Income	Count_3-6_months_late	Count_6-12_months_late	Count_more_than_12_months_late	application_underwriting_score	no_of_premiums_paid	sourcing_channel	residence_area_type	premium	target
0	110936	0.429	12058	355060	0.0	0.0	0.0	99.02	13	C	Urban	3300	1
1	41492	0.010	21546	315150	0.0	0.0	0.0	99.89	21	A	Urban	18000	1
2	31300	0.917	17531	84140	2.0	3.0	1.0	98.69	7	C	Rural	3300	0
3	19415	0.049	15341	250510	0.0	0.0	0.0	99.57	9	A	Urban	9600	1
4	99379	0.052	31400	198680	0.0	0.0	0.0	99.87	12	B	Urban	9600	1
5	59951	0.540	17527	282080	2.0	0.0	0.0	99.18	9	B	Rural	22200	1
6	54031	1.000	24829	118400	0.0	0.0	0.0	99.05	11	B	Urban	7500	1
7	94290	1.000	21911	180240	1.0	6.0	4.0	99.33	3	A	Urban	9600	0
8	93730	0.621	9868	92520	0.0	0.0	0.0	99.58	4	A	Urban	7500	1
9	84844	0.908	23008	107180	2.0	0.0	0.0	98.91	11	A	Rural	5400	0

Last rows

	id	perc_premium_paid_by_cash_credit	age_in_days	Income	Count_3-6_months_late	Count_more_than_12_months_late	application_underwriting_score	no_of_premiums_paid	sourcing_channel	residence_area_type	premium	target
79843	84628	0.454	25928	70800	0.0	0.0	98.19	7	A	Urban	5700	1
79844	11262	0.994	20445	186830	0.0	0.0	99.67	5	A	Urban	18000	1
79845	25366	0.825	14979	360060	2.0	0.0	98.61	10	D	Urban	24300	1
79846	104705	0.118	22275	195070	0.0	0.0	99.25	11	A	Urban	9600	1
79847	91081	0.033	18265	301540	0.0	0.0	99.89	4	A	Rural	13800	1
79848	48057	0.425	23367	224550	1.0	0.0	98.70	19	B	Urban	13800	1
79849	59012	0.704	19356	279150	1.0	1.0	99.42	12	A	Rural	28500	1
79850	77050	0.000	23372	305020	0.0	0.0	98.89	12	A	Rural	9600	1
79851	67225	0.398	22641	39330	0.0	0.0	98.68	8	A	Rural	5700	1
79852	71531	0.550	15709	280140	1.0	1.0	99.84	8	A	Urban	9600	0

Overview

Variables

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Uppercase Letter

Most occurring scripts

Most frequent character per script

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Uppercase Letter

Most occurring scripts

Most frequent character per script

Latin

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Pie chart

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows